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Abstract 


We describe a new algorithm for the decoding of Reed Solomon codes. This algo- 
rithm was originally described in [12]. While the algorithm presented in this article 
is the same, the presentation is somewhat different. In particular we derive more 
precise bounds on the performance of the algorithm and show the following: For an 
[n, Kn, (1—K)n], Reed Solomon code, the algorithm in [12] corrects (€(«) —o(1))n errors 
in polynomial time, where 


1 XT 1 
e(K) = 1- — Phy where py = =~4- =], 
l+p, 2 i a) 


We also present the following two (hopefully) useful lower bounds on e€(k): 


2 
VK € [0,1] en) >1-\)2e+ 45 >1-v2 


1 Introduction 


For integers n,& and gq such that a finite field of size q exists, the Reed Solomon codes are 
[n, k, d = n — k] codes over the alphabet F' = GF(q) (the Galois field of order q). The code 
may be obtained by letting a message m = mo...m,_1 denote the coefficients of a degree 
k —1 polynomial M(x) = a, m;x! and letting the encoding of m be C(m) = 1... ¢n 
where ¢; = M(a;) where x1,...,2, are n distinct elements of F. (It is standard to pick 
n = q-—1, though not necessary to prove the distance property or for the algorithms we 


describe). 


In this paper we consider the following bounded distance decoding problem: 


Input: Integers n, k and e; and n pairs {(2;,y;)}"), @i,yi € F with 2x,’s being distinct?. 
Goal: Find all polynomials p1,..., pm of degree k —1 such that for every j € [m], p;(ai) 4 yi 
for at most e values of 7 € [n]. 


As can be seen easily, this problem captures the bounded distance decoding problem for Reed 
Solomon codes. There is a rich history of work associated with this problem. The classical 
work of Berlekamp-Massey (cf. [2, 9]), corrects upto |(d — 1)/2| errors. Sidelnikov [11] and 
Dumer [4] have constructed algorithms which correct up to |(d — 1)/2| + clogn errors for 
any constant c [4, 11]. We give an algorithm that improves over these results when k/n is 
sufficiently small (i.e., less than 1/3). Our algorithm is motivated by an algorithm of Welch 
and Berlekamp [14, 3] which corrects |(d —1)/2] +1 errors. In this article we describe the 
algorithm of Welch and Berlekamp and use it motivate our decoding algorithm. We also 
describe a crucial intermediate step from [1] which forms the basis of our algorithm. Our 
main result is summarized below and proven in Lemma 9. 


Theorem 1 For every ¢, « The bounded distance decoding problem with parameters n, k = 
Kn and e = é(K)n can be solved in polynomial time provided 


1 kK 2 1 1 
x) <1 = Fe where px = 244-3) 


2 Decoding with univariate rational functions [14, 3] 


The idea of Welch and Berlekamp [14, 3] can be informally described as follows: They 
describe how a “rational function” in x can be used to “explain” the “data” {(2;, y;)}4. 
They then show how to efficiently find a rational function that explains the data and then 
show how to use this rational function to find the (unique) polynomial p which disagrees 
with the data in at most e places. We now describe the algorithms more formally. 


Lemma 2 ((14, 3]) Given n points {(a;, yi) }%_, such that there exists a degree k — 1 poly- 
nomial p such that y; # p(x;) for at most e values of i, the following hold: 


1. There exist polynomials N(x) and D(x) where deg(N) <k—1+.e, D is monic with 
deg(D) = e, such that for every i € [n], N(x;) = y;D(a;). (Informally, we could say 
that y; equals the rational function *(a).) 


2. Such a pair of polynomials (N,D) can be found in polynomial time. 
3. For any such pair of polynomials (N, D), *(:) = p(-), provided e < $(n—k). 
Remark: As a consequence p can be found in polynomial time. We just divide the polyno- 


mials N and D to obtain p. 


For our algorithm from [12] we can replace this condition with the weaker one that (2;, y;)’s are distinct. 


Proof: Let E(«) be an “error-locator” polynomial, i.e., E(x;) = 0 if (but not necessarily 
only if) y; # p(a;). Notice that FE has degree at most e and w.l.o.g. we can allow it to 
be monic and have degree exactly e. We now notice that the polynomials D(-) = E(-) and 
N(-) = p(-)E(-) satisfy the condition N(x;) = y;D(a;) for every 7. This proves Part 1. 


To see Part 2, notice that if we let the unknowns {nj }otp77 denote the coefficients of N(-) 
and let the unknowns {d;}‘_) denote the coefficients of D(-), then the constraints N(2;) = 
y:D(x;) give linear constraints on the unknowns {n;}’s and {d;}’s. Also the constraint 
deg(D) = e. We do so by setting the linear constraint d. = 1. Thus a solution pair (NV, D) 
can be found efficiently by solving a linear system.” 


Finally notice that there exists a pair (N, D) such that *(:) = p(-), as described in the proof 
of Part 1. Thus to prove Part 3, it suffices to prove that for any pair of solutions (Ni, D1) 
and (No, D2), satisfying N;(a;) = y;D;(a;) every 7 € [n] and j € {1,2}, S(-) = *(-). To 
see this, first observe that for every 7 € [n], we have Ni(a;)Do(ai)y; = No(x;)D1i(21)yi). 
Futhermore, we can cancel y; from both sides (even if y; = 0, since in such a case we have 
Ni(a;) = No(v;) = 0. This yields that for every 7, (Ni D2)(a;) = (N2D1)(2;). But then both 
sides describe polynomials of degree 2e + & — 1 and two sides agree on n points. By the 
condition on n, we have that n > 2e + k — 1 and thus the polynomials on the two sides are 


identical, i-e., (Ni D2)(-) = (N2D1)(-). This yields the desired conclusion immediately. | 


3 Decoding with algebraic curves in the plane [1, 12] 


A slightly different interpretation of the Welch-Berlekamp algorithm is that it finds an alge- 
braic curve in the plane which “explains” the “data”. To be precise, the algorithm finds a 
function Q(#,y), where Q(x, y) = D(x)y — N(x), such that for every 7 € [n], Q(a;, y;) = 0. 
While this particular scenario attempts to explain the data by a “linear” polynomial in y 
- there is no need to restrict the analysis to this situation. Ar et al. [1] considered such a 
generalization. They consider the case where the data is “explained” some algebraic curve 
Q of low degree in y (but not necessarily a linear polynomial in y). They show that in such 
a case, if there exists a polynomial p such that y; = p(x;) for many values of 7 (compared 
to deg,(Q) and deg, (Q)) then p can be reconstructed easily. To describe their analysis, the 
following definition is useful. 


Definition 3 For positive integers w, and wy, the (wz, w,)-weighted degree of a bivariate 
polynomial Q(2,y) = Xi; Gijz'y’ is defined to be max{iw, + jwy|qi; Z Of. 


Lemma 4 ((1]) Given n points {(x;,y;)}%, s.t. there exists a bivariate polynomial Q sat- 
isfying: 

The (1,k — 1) weighted degree of Q is at most D, Q £0 and Wi € [n], Q(ai,y;) = 0. (1) 
Then the following hold: 


? Actually Berlekamp and Welch [14, 3] give a much more efficient solution for this task, but we will not 
describe their solution here. 


1. A polynomial Q satisfying equation (1) can be found in polynomial time. 


2. If p is a polynomial in x of degree at most k —1 such that y; # p(a;) for at most 
e<n-—D values of i then for any polynomial Q satisfying (1), it is the case that 


(y — p(x)) divides Q(x, y). 


Remark: As a consequence, a small set of polynomials which includes p can be found in 
polynomial time. We simply factor the polynomial Q obtained in Part 1 above and output 
all p such that y — p(x) divides Q. The polynomial Q can be factored in time polynomial in 
its degree using the algorithm of Kaltofen [7] or Grigoriev [6] (see also Kaltofen [8]). 


Proof: For Part 1, we observe as in the proof of Lemma 2 that for any 7, the condition 
Qty) = Ly qiv'y! = 0 is a linear constraint on the unknowns gq;;. Thus a solution 
satisfying (1) can be found in polynomial time, if one exists. 


For Part 2, we consider the polynomial g(x)2Q(a, p(x)). Notice that since the (1,& — 1)- 
weighted degree of Q is D, the degree of g is also at most D. Notice further that if for 
some i € [n], y; = p(a;), then g(a;) = Q(a;,p(2i)) = Q(vi,y;) = 0. Thus g is zero on 
n—e> D points. Thus g is identically 0. Now consider the polynomial Q.(y)ZQ(e, y) (Le, 
the polynomial Q viewed as a polynomial in y with coefficients from the ring of polynomials 
in x). By the division theorem for polynomials we have that if Q,(¢) = 0, then y — ¢ divides 
Q.(y). Applying this fact to Q,(p(x)) = Q(2, p(x)) = g(x) = 0 we find that y — p(x) divides 
Q(x,y). 


Notice the close correspondence between Lemmas 2 and 4. The main difference between the 
two is Part 1 of Lemma 2, the analog of which is missing in Lemma 4. As a result Lemma 4 
works conditionally, i.e., only when the “data” is explained by a low-degree algebraic curve. 
Our solution complements this by providing a “triviality” result. Namely, we observe that 
every set of points lies on a low degree algebraic curve; low enough to make Lemma 4 always 
useful! We illustrate this observation by a simple example 


Example 5 For any set of points {x;,y:}%_, there exists a non-zero polynomial Q with 


deg,,(Q), deg,(Q) < [vn]. 


Proof: Consider the linear system Q(x,y) = yal ylvel girly! = 0. For every 7 this 
forms a homogenous linear system. The system has n constraints on ([,/n + 1])? > (/n + 
1)? >n+1 unknowns. By just counting the number of unknowns we know that the system 
has a non-zero solution (any homogenous linear system with more variables than unknowns 


has a non-zero solution). I 


Notice that unlike in Part 1 of Lemma 2, we didn’t even use the fact that the data has some 
agreement with a degree k — 1 polynomial. Thus the example above is a “triviality” result 
- it holds for any set of n points. Yet the trivial result can be useful as seen next: 


Example 6 For any set of n distinct points {(a;, yi) }%_, the following hold: 
1. There exists a bivariate polynomial Q satisfying equation (1) with D = k\/n. 
2. Such a polynomial Q can be found in polynomial time. 


3. If p is a polynomial in x of degree at most k — 1 such that y; 4 p(a;) for at most 
e<n—k[/n| values of i then for any polynomial Q satisfying (1) with D = ky/n, it 
is the case that (y — p(a)) divides Q(a, y). 


Proof: Part 1 follows from Example 5. Parts 2 and 3 follow from Parts 1 and 2 of Lemma 4 


with D=k[ Yn]. I 


Notice that Example 6 is already correcting more errors than guaranteed by Lemma 2 for 
some values of n and & (in particular when k grows as o(,/n). By some fine tuning we can 
actually get to the point where this algorithm always does at least as well as the Welch- 
Berlekamp algorithm and for rate less than 1/3 it starts correcting significantly more error. 
The fine tuning is performed by minimizing the weighted (1,4 — 1) degree of the polynomial 
Q which is used to explain the data. 


Lemma 7 Given n and k, let t be the smallest positive integer satisfying: 


eos] Sad) (Ga) > 


Then, for any set of n distinct points {(a;, y;)}%, the following hold: 


1. There exists a bivariate polynomial Q satisfying: 


The (1,k —1) weighted degree of Q is <t, Q #0 and Vi € [n], Q(vi,y;) =0. (2) 


2. A polynomial Q satisfying (2) can be found in polynomial time. 


3. Ifpis a polynomial in x of degree at most k—1 such that y; # p(a;) for at moste <n—t 
values of i then for any polynomial Q satisfying (2), it is the case that (y—p(a)) divides 


Q(x, y). 


Remark: Again as a consequence we can find a list of all polynomials p that agree with the 
points {(x;, y;)} in n — e points in time polynomial in n. 


Proof: A polynomial Q of (1,4 — 1)-weighted degree t is allowed to have a non-zero co- 
efficient gj if 7 + (k — 1) < t. Counting the number of such coefficients we find that Q 
has 


lz! 


Eee) (S] +) 59 (a] +4) ad) 


i=0 


coefficients. Since this number is strictly greater than n we must have a non-zero solution. 
This proves Part 1. Parts 2 and 3 follow directly from Lemma 4. 


4 Some bounds 


Let e(k,n) denote the maximum number of errors corrected by the algorithm of Lemma 7 


on an [n,k,d], Reed Solomon code. Let « = k/n denote the rate of a code and let €(x) S 
limps e(Kn,n)/n denote the asymptotic error-correcting rate of the algorithm. In this 
section we derive the exact form of e(k,n) and e(K). We also describe some lower bounds to 
both quantities. 


Lemma 8 


2n — (k= l)ren(1in + 1) 


e(k,n) = (= 1)ran | 2(T kn + 1) 


|—2utererin = | ——_—4--- 


Proof: Let t be the smallest integer satisfying 


(a) -S" (d+) (Ga) > 


By Lemma 7 e(k,n) =n —t—1. Let t—1=r(k —1)+4+ 5, where r and s are integers and 
0<s<k-—1. Then |=] =r; andr and s satisfy 


(r(k —1)+s)(r +1) weirs >on. (3) 


We first determine r based on the above. The constraints 0 < s < k —1 translate into the 
constraints: 


r(k—1)(rt+l)—r(k-1)(r41)/2 < n+] and (r+ 1)(k-1)(r41)—r(k-1)(r4+1)/2 > n41. 


The above, in turn, simplify to 


2n4+1) 1 1 2(n + 1) 
<j = po 1-1. 
r< bol 7 5 and r > | 1-1 


The requirement that r be an integer now allows us to determine r precisely: 


-| Ant) 1 , 


k—1 4 2 


The value s can now be determined from (3) and we get: 
_ 2(n +1) —r(r + 1)(k-1) 
7 2(r + 1) 


The lemma follows by setting r,, = r and t = r(k —1)+8+4 1 and using the fact that 
e(k,n) =n—t—1. | 


The following lemma simplifies some of the expressions above by examining the error- 
correction rate €(«) as a function of k. 
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Figure 1: The new error correction bound ¢(«) plotted against the rate x. 
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Lemma 9 


E(k) can be lower bounded as follows: 


E(k) = 1 


rate (k/n) 


radius of the code and the distance of the code. 
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Va € [0, 1], 


ea 


€(K) 


— Pee where Pr 
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1-V2k 


Also described are 


(5) 
(6) 


Remark: The bound (4) is described pictorially in Figure 1. The lower bounds (5) and (6) 
are compared against the bound (4) in Figure 2. 


Proof: (4) follows from Lemma 8 by letting p, = limp+co Tsn,n and simplifying the quantity 


littin sop Esti) m. 


To prove (5), we first show that 


1 T T T T 

! New Correction Bound —— 
\ Lower Bound 1: (1 + x/2 - sqrt(x*2/4 + 2x)) ---- 
i Lower Bound 2: (1 - sqrt(2x)) ----- 
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Figure 2: Lower bounds on the error-correction rate of our algorithm. 
where p/, = ,/2 + 4 — 3. Notice that by the definition of p/,, we have 


, 
Pr S Px SP,tl and —=(p, + 2)(p, +1). 


(7) follows from: 


1 oo ea Pe ye Pw 


T+p, Ttp5 | a fe oe 0 
= (pn — Pe) TEE ror ;-§) > 0 
- TG) 2 2 0 (Since p, > p\) 
~ Greate) = Traperay (Since = (1+ p.)(2+ pe) 
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where the last inequality follows from the properties of p/.. 


(5) now follows from the following equalities: 
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Finally inequality (6) is derived easily as follows: 


to 
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5 Conclusions 


The algorithm as presented here does generalize naturally to dealing with erasures, for the 
simple reason that we made no assumptions about the «,;’s (we didn’t depend on them being 
in some specific order etc.). However the bounds can not be represented elegantly in any 
form - so we do not attempt to do so here. We only point out that since the Welch-Berlekamp 
algorithm is a special case of ours, we do at least as well. 

There are a number of questions on decoding Reed Solomon codes that remain open. For 
instance, is there an algorithm that can decode from more errors (than (d — 1)/2) when 
& =k/n > 1/3? A nice target would be a decoding algorithm that works for e(«) < 1— Jk. 
In this case we know (cf. [5, 10]) that the number of codewords within a distance of e(«)n 
is bounded by a polynomial in n. One does expect that the problem will become harder as 
e(k) — 1—k. It would be interesting to see if the problem becomes NP-hard as e(k) > 1—k. 
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